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Abstract 



The results of 3 experiments in Costas arrays are presented, for which theoretical explanation is still not 
2 . available: the number of dots on the main diagonal of exponential Welch arrays, the parity populations of 

Golomb arrays generated in fields of characteristic 2, and the maximal cross-correlation between pairs of Welch 
, or Golomb arrays generated in fields of size equal to a Sophie Germain prime. 
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, novel frequency hopping pattern for SONARs with optimal auto-correlation properties. At that stage their 



1 Introduction 

Costas arrays appeared for the first time in 1965 in the context of SONAR detection ( [5] , and later [6] as a journal 
publication), when J. P. Costas, disappointed by the poor performance of SONARs, used them to describe a 



study was entirely empirical and application-oriented. In 1984, however, after the publication by S. Golomb [13] 
of the 2 main construction methods for Costas arrays (the Welch and the Golomb algorithm) based on finite 
fields, still the only ones available today, they officially acquired their present name and they became an object 
of mathematical interest and study. 

Soon it became clear that the mathematical problems related to Costas arrays presented a challenge for our 
^ ■ present methodology in Discrete Mathematics (Combinatorics, Algebra, Number Theory etc.), and suggested 

^SJ ' that novel techniques are desperately needed, perhaps currently lying beyond the frontiers of our knowledge. 

, Indeed, we have so far been unable to settle even the most fundamental question in the field: the issue of the 

CO ' existence of Costas arrays for all orders. 

CO I These insurmountable difficulties the researchers were faced with triggered inevitably an intense activity 

. in computer exploration of Costas arrays (for example [T] [31 IIOI I17j). the rationale being that it is easier to 

' prove something on which strong evidence has been gathered, rather than starting completely from scratch. 

, Such evidence led to the formulation of conjectures, some of which subsequently were, at least partially, proved. 

■ These successes, however small, helped consolidate the position of the experimental method as an indispensable 

tool for the study of Costas arrays. 

Not all computer experiments have led to conjectures, however, let alone successfully proved conjectures: 
' several experiments, perhaps the most interesting ones, yielded results that still defy any attempt for explanation. 

?— ^ ' In this work we collect our findings in 3 numerical experiments we performed on Costas arrays, whose results 

appear very interesting, but entirely inexplicable at present, and we present them to the broader scientific 
community, hoping to accelerate progress towards their solution. They are: 

• The number of dots on the main diagonal of exponential Welch arrays; 

• The parity populations of Golomb arrays generated in fields of characteristic 2; 

• and the maximal cross-correlation between pairs of Welch or Golomb arrays generated in fields of size 
equal to a Sophie Germain prime. 
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The reason for choosing these particular 3 experiments is that, having spent lots of time studying them, we 
can confidently say that a lot more is to be gained than mere deeper understanding of Costas arrays through 
their successful explanation: in our opinion, such an explanation relies on completely novel, as yet unexplored 
areas of finite fields, and traditional algebraic and number theoretic methods are totally incapable of making any 
progress. In other words, these problems, although originating in the relatively unknown field of Costas arrays, 
reveal new directions in Algebra and Number Theory, and are, consequently, of paramount pure mathematical 
interest. 



2 Basics 



In this section we give precise definitions for all the terms used in the introduction, as well as for everything 
else needed in the paper. 



2.1 Definition of the Costas property 

Simply put, a Costas array is a square arrangement of dots and blanks, such that there is exactly one dot per 
row and column, and such that all vectors between dots are distinct. 

Definition 1. Let f : [n] ^ [n], where [n] = {1, . . . ,n}, n £ N, be a bijection; then / has the Costas property 
iff the collection of vectors {{i — j, f{i) — f{j)) : 1 < i < i < ?^}, called the distance vectors, are all distinct, in 
which case / is called a Costas permutation. The corresponding Costas array Af is the square array n x n where 
the elements at {f{i),i), i € [n] are equal to 1 (dots), while the remaining elements are equal to (blanks): 

r 1 fl if ^ = /(j) . r 1 
I otherwise 

Remark 1. The operations of horizontal flip, vertical flip, and transposition on a Costas array result to a 
Costas array as well: hence, out of a Costas array 8 can be created, or 4 if the particular Costas array is 
symmetric. 



2.2 Construction algorithms 

There are 2 known algorithms for the construction of Costas arrays. We state them below omitting the proofs 
(which can be found in [71 [13] in full detail) : 

Definition 2 (Exponential Welch construction Wi{p, g, c)). Let p be a prime, g a primitive root of the flnite 
field F(p), and c £ [p — 1] — 1; the exponential Welch permutation corresponding to g and c is defined by 
/(«) = g''^^" mod p, ie [p-l]. 

Remark 2. Given a Wi permutation, it is well known that its horizontal and vertical flips also correspond to 
Wi permutations; its transpose, however, does not: it is what we deflne as a logarithmic Welch permutation. 
The distinction is well defined as, for p > 5, there are no symmetric W2 arrays. We will no further consider 
logarithmic Welch permutations in this work, so "Welch" will henceforth be synonymous to "exponential Welch" . 

Definition 3 (Golomb construction G2{p,m, a,b)). Let q = p'", where p prime and m G N*, and let a, b be 
primitive roots of the finite field ¥{q); the Golomb permutation corresponding to a and b is defined through the 
equation a' + 6^**^ = 1, i e [q - 2]. 

Remark 3. The horizontal and vertical flips of a G2 permutation are themselves G2 permutations, just like in 
the Welch case; this time, however, the same holds true for transpositions as well. 

Remark 4. The indices in Wi and G2 have the significance that the methods produce permutations of orders 
1 and 2 smaller than the size of the finite field they use, respectively. It is well known that both methods can 
be extended to yield a wide range of sub-methods; in this paper, however, we will focus exclusively on the 2 
aforementioned main construction methods. 

2.3 Cross-correlation 

We now give a precise definition of the cross-correlation between 2 Costas arrays: 

Definition 4. Let /, g : [n] ^ [71] where n G N* , and let u,v £ Z; the cross-correlation between / and g at 
{u, v) is defined as 

'^fA^,-") = \{{f{i)+v,i + u) : i e [n]} n {(<?(»), i) : i G N}| (1) 
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Informally, we can think of the cross-correlation in the following way: first, we place the 2 Costas arrays on 
top of each other, and then we translate the first by v units vertically and u horizontally; the number of pairs 
of overlapping dots in this position is the value of the cross-correlation at {u, v). 

Remark 5. If either one of the 2 "-f" signs in ([T} is interpreted as modulo addition, the cross-correlation 
becomes periodic in the corresponding direction. More precisely, in the treatment of the Welch case that is 
about to follow, it is natural to interpret i + u as a, modulo addition, so that the cross-correlation between Wi 
arrays is periodic in the horizontal direction, while in the dovetailing treatment of the Golomb case it is natural 
to interpret both i + u and f{i) + v as modulo additions, so that the cross-correlation between G2 arrays is 
periodic in both directions. 

2.4 Parity populations 

Definition 5. Let f : [n] ^ [n], n £ N* , he a function; set: 

• ee(/) = \{i £ [n] : i mod 2 = f{i) mod 2 = 0}| to be the even-even population; 

• oo(/) — \{i £ [n] : i mod 2 — f{i) mod 2 — 1}\ to be the odd-odd population; 

• eo(/) = \{i £ [n] : i mod 2 — 1, f{i) mod 2 = 0}| to be the even-odd population; 

• oe(/) = \{i £ [n] : i mod 2 = 0, f{i) mod 2 = 1}| to be the odd-even population; 
If / is a permutation, the parity populations are closely connected: 

Theorem 1. Let / : [n] — > [71], n £ N*, be a permutation; then 
. ee(/) + oo{f) + eo{f) + oe{f) = n; 

• oe(/) = eo(/),- 

• oo(/) — ee(/) — n mod 2. 

Proof. This is actually a very simple, almost obvious result. Clearly, ee + eo — ee-\- oe, as both sums equal the 
number of even integers in [n]; hence, eo = oe. Further, 00 -f oe is the number of odd integers in [n], whence: 

I 1 if n mod 2 = 1 

00 + oe — (ee -f eo) = 00 — ee = < 

1 if n mod 2 = = n mod 2 

□ 

There is then only one degree of freedom: if one of the populations is given, all 4 can be determined. 

2.5 Sophie Germain primes 

A very special family of primes will play an important role in Section O 

Definition 6. A prime p is a Sophie Germain prime [TS] iff p = 2g -I- 1, where q prime. 

It is not known whether this family contains infinitely many primes, although it is conjectured to do so. 



3 The number of dots on the main diagonal of exponential 
Welch arrays 

In accordance with Definition [2] given a prime p, we are interested in the number of solutions of 

i = g^~^'^'^ mod p (2) 

with respect to i, where g is a primitive root of the field ¥{p) and c £ [p — 1] — 1 is a constant. 

Equation ([2} strikes one immediately as "unalgebraic" : the i on the RHS is simply an index, and in particular 
an integer in [p — 1] — 1, based on Fermat's Little Theorem; the i on the LHS, however, is an element of F(p), 
and elements of F(p) just happen to be representable by integers because F(p) is a field of prime size and not an 
extension field (whose elements are routinely represented as polynomials). In other words. Algebra traditionally 
considers the 2 instances of i in @ as different, non-comparable objects, and these 2 object types happen to 
coincide in finite fields of prime size; the solution of this equation then needs to exploit properties of these 
fields not present in extension fields, where this equation is impossible to formulate in the first place, and this 
probably means that we need to consider F(p) as something more complex than a field. 
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Figure 1: Plot of the ratio of Wi arrays with no dots on the main diagonal over the total number of Wi arrays 
generated in ¥{p) as a function of p 



The bottom line is that we are left with a transcendental equation over a finite field. Such equations have 
almost not been studied at all, as opposed to polynomial equations, on which the literature is abundant. The 
only instance of a relevant problem studied in the literature (that we have been able to trace) has been one 
proposed by Demetrios Brizolis: is it true that Vi G [p — 1] G [p — 1] : i = g' mod p? This was answered 
in the affirmative by W. P. Zhang [l^ for sufficiently large primes, and later C. Pomerance and M. Campbell 
"made the value of "sufficiently large" small enough that they were able to use a direct search to affirmatively 
answer Brizolis' original question" ([TJ] and references therein). Observe, though, that this is quite a different 
problem than the one we are interested in. 

Let S{p,g,c) = j |i G [p — 1] : i = g'^^^'^lj, namely the number of solutions of © for a given constant c and 
a primitive root g G F(p), p prime. Table[l]shows max S{p, g, c) for all p < 5000: the data do not seem to follow 

a recognizable pattern, but they roughly seem to behave "logarithmically'^^- Indeed, 1 + [ln(p)], where [•] is the 
rounding function, seems to fit the data very well: 402 out of 669 entries (60.1%) are captured exactly, while 
652 entries (97.5%) are captured within an error margin of ±1. 

Finally, here is an interesting additional side observation we made during our experiments: it is a well known 
result in Combinatorics ( "The problem of the misadressed letters" ) that the ratio of permutations of order n 
without fixed points over the total n! permutations approaches e^^ = 0.3678794 . . . as n — > oo. What can be 
said about the ratio of the population of Wi permutations with no fixed points at all generated in F(p) over the 
totality of (p — l)0(p — 1) Wi arrays? It is plotted in Fig. [T]and seems to approach e^^ as well, although the 
data shows still some fluctuation in the given range of p. 

4 The parity populations of Golomb arrays generated in fields 
of characteristic 2 

The parity populations for both Wi and G2 arrays generated in fields of odd characteristic have already been 
completely described [5]: 

Theorem 2. Let a permutation be generated by G2{p, m, a, 6), p > 2, g = p™. Then: 
graph of these resuhs for p < 1000 was presented in [8] 
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3319 


8 


3851 


10 


4421 


9 


4993 


9 


317 


6 


751 


7 


1223 


8 


1709 


8 


2243 


10 


2749 


9 


3323 


8 


3853 


9 


4423 


9 


4999 


9 


331 


6 


757 


8 


1229 


8 


1721 


8 


2251 


8 


2753 


8 


3329 


10 


3863 


10 


4441 


10 







Tabic 1: The maximum number of solutions of the equation i g* ^^"^ mod p over all possible values of c and 
primitive roots g G F(p), p < 5000. 
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• If q = I mod 4 ee = , eo — oe = oo = ; 

^ 4 ' 4 

rj-o 1^ 9+1 9 — 3 

• If q = 6 mod 4 oo = , eo = oe — ee — . 

■' 4 4 

Theorem 3. Let permutation be generated by Wi{p,g,Q). Then: 

• If p = 1 mod 4 ee = oo = eo = oe; 

• If p = 3 mod 8, t/ien eo — ee = —3h{—p); 

• If p = 7 mod 8, t/ien eo — ee = h{—p), 

where h{—p) is the Class Number for discriminant —p. 

1 ''^^ / i\ 

For p > 3, h(—p) = I - J i, where (7) denotes the Legendre symbol |16) . 

P \P / 

Although the proofs (omitted here, but see [5] for details) are not necessarily easy (in particular the parity 
populations of Welch arrays involve the quite advanced concept of the Class Number [2]), the statements certainly 
are: the parity populations of G2 arrays generated in F(p'"), p > 2, are independent of the primitive roots a 
and b used. The same holds essentially true for Wi arrays, except that changing the value of c by 1 causes ee 
and eo to swap values; as Wi arrays are of even order, horizontal or vertical flips have the same effect, changing 
the parity of the corresponding coordinate of the dots. 

This uniformity holds no longer true for G2 arrays generated in fields of characteristic 2: here, the parity 
populations can take many different values, which appear to follow no readily recognizable pattern. As these 
arrays have even order, however, the same phenomenon that we observed in Wi arrays applies here: for each 
array with parity populations ee and eo, there exists another (its horizontal and vertical flip) with these values 
swapped; hence, there as many arrays with ee = a: and eo = y as with ee = y and eo — x. The different parity 
populations observed in G2 arrays generated in the fields of size 2™, m = 3, . . . , 11 are shown in detail in Table 
[51 due to the symmetry we just mentioned, only (the top) half of the array is shown. 

Table [2] shows only the simplest instance of a general phenomenon: consider fc G N* and consider the 
generalized parity populations modulo fc. If fc happens to be a prime, then the G2 arrays generated in fields of 
characteristic k exhibit similar behavior. Clearly, Table [5] corresponds to the first case fc = 2. As we have not 
experimented extensively with k > 2, however, we avoid presenting any results at this time. 



5 The maximal cross-correlation between pairs of Wi or G2 
arrays generated in Germain prime finite fields 

We have at present a fairly good understanding of the maximal cross-correlation between pairs of Wi or G2 
arrays generated in a certain field. We have not been able yet to prove these results in their entirety, but we 
have been able to formulate conjectures that complete the rest of the picture. These conjectures have been 
based on numerical data that almost leave no doubt about their truth. We present our result below in a series 
of theorems and conjectures, in order to show clearly what has been proved rigorously so far (for proofs and 
more details see [lOj): 

p - 1 

Theorem 4. Let fi and /2 be Wi permutations generated in F(p), p prime; then, max ^/i,/2('"iO) — > 



where q is the smallest prime dividing 
iff 



P - 



{/1//2) 

More precisely, i/{pi}^Q is the sequence of primes, q — pi, / £ 



ao- 



Mi 



Mi 
~4~ 



mod 4 



+ > ai 



mod Pi 



mod Mi 



where Mi = 4]^Pi, Oi £ {2, . . . ,pi — 1}, < i < /, a/ = 1, and ao = 3 if I > 0. 

1=1 

Remark 6. In the theorem above, as well as in all subsequent results concerning the cross-correlation of Wi 
arrays, the condition /i 7^ /2 will be taken to imply the somewhat stronger condition that fi ad /2 are generated 
by different primitive roots (as opposed to, say, being generated by the same g but different values of c). As the 
context makes this always clear, we find it unnecessary to use a different symbol and clutter the notation. 
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m = 3 




ee 


eo 


# 


1 


2 


6 


m = 4 


ee 


eo 


# 


2 


5 


4 


3 


4 


4 


m = 5 


ee 


eo 


# 


5 


10 


10 


6 


9 


40 






7 


8 


40 




m = ; 










ee 


eo 


# 








110 


145 


8 


ee 


eo 


# 


111 


144 


8 


12 


19 


12 


112 


143 


32 


13 


18 


22 


113 


142 


26 


14 


17 


54 


114 


141 


90 


15 


16 


20 


115 


140 


112 


m = 7 


116 


139 


156 


ee 


eo 


# 


117 


138 


350 


24 


39 


4 


118 


137 


426 


25 


38 


20 


119 


136 


496 


26 


37 


44 


120 


135 


668 


27 


36 


104 


121 


134 


756 


28 


35 


140 


122 


133 


872 


29 


34 


206 


123 


132 


1020 


30 


33 


336 


124 


131 


1232 


31 


32 


280 


125 


130 


1296 


m = 8 




126 


129 


1436 


ee 


eo 


# 




127 


128 


1384 


53 


74 


10 






54 


73 


4 




55 


72 


12 




56 


71 


36 




57 


70 


62 




58 


69 


106 




59 


68 


156 




60 


67 


116 




61 


66 


166 




62 


65 


178 




63 


64 


178 





m = 10 


ee 


eo 


# 


229 


282 


2 


230 


281 


4 


231 


280 


4 


232 


279 


16 


233 


278 


38 


234 


277 


34 


235 


276 


60 


236 


275 


62 


237 


274 


142 


238 


273 


164 


239 


272 


248 


240 


271 


354 


241 


270 


326 


242 


269 


532 


243 


268 


560 


244 


267 


792 


245 


266 


832 


246 


265 


874 


247 


264 


972 


248 


263 


1130 


249 


262 


1276 


250 


261 


1282 


251 


260 


1524 


252 


259 


1620 


253 


258 


1654 


254 


257 


1718 


255 


256 


1780 



m = 11 


ee 


eo 


# 


472 


551 


4 


473 


550 


16 


475 


548 


4 


476 


547 


4 


477 


546 


56 


478 


545 


72 


479 


544 


120 


480 


543 


136 


481 


542 


224 


482 


541 


348 


483 


540 


444 


484 


539 


488 


485 


538 


782 


486 


537 


908 


487 


536 


1340 


488 


535 


1400 


489 


534 


1730 


490 


533 


2090 


491 


532 


2732 


492 


531 


3020 


493 


530 


3466 


494 


529 


4062 


495 


528 


4752 


496 


527 


5300 


497 


526 


5774 


498 


525 


6226 


499 


524 


6948 


500 


523 


7232 


501 


522 


7946 


502 


521 


8442 


503 


520 


8932 


504 


519 


9244 


505 


518 


9426 


506 


517 


10180 


507 


516 


10952 


508 


515 


10848 


509 


514 


11790 


510 


513 


11306 


511 


512 


11624 



m 


Length 


3 


1 


4 


2 


5 


3 


6 


4 


7 


8 


8 


11 


9 


18 


10 


27 


11 


39 



Table 2: The various different parity populations for G2 arrays generated in F(2'"), m = 3,..., 11: the third 
column of each array shows the number of G2 arrays with the given ee and eo. The last array contains the number 
of different parity populations appearing for each given m, namely the number of rows of the array corresponding 
to m. Note that the bottom half of the arrays, which is the same as the top half but with the values of ee and eo 
swapped, is omitted. 
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Theorem 5. Let fi and f2 be Wi permutations generated in F(p), p prime, and let f[ and f2 be G2 permutations 
generated in the same field by some primitive roots a and b, and and b, respectively, where {r,p — 1) = 1, 
r > 1. Then: 

max 'iff, J, (0, 0) = max (0, 0) + 1 (3) 

Conjecture 1. Let /i and be Wi permutations generated in ¥{p), p prime but not a Germain prime. Then: 

max max */i (^*. « ) = , max (0, 0) (4) 

{",1') {/l5^/2) (/l#/2) 

Conjecture 2. Let /i and /2 be G2 permutations in F(p), where p 7^ 19 is prime but not a Germain prime, 
and similarly let /{ and /2 be G2 permutations in the same field with the second primitive root in common. 
Then: 

max max */i (^t, t;) = max 'i'f (0, 0) (5) 

Combining all of the above, we can formulate a very strong result: 

Conjecture 3. Let p 7^ 19 be a prime other than a Germain prime, let /i and /2 be Wi permutations, and let 
f[ and /2 be G2 permutations, all generated in F(p). Then: 

max max (u, v) = max max j/ (m, v) + 1 (6) 

{",1') (A 7^/2) {".") (/iT^/a) 

We will not present here the data that led to the formulation of these conjectures, as they conform entirely 
with what the conjectures suggest; instead, we wish to present data about what the conjectures do not cover, 
namely the Sophie Germain primes. We also ignore 19, which seems to be an one-time half- irregular occurrence 
(regular for Wi arrays but irregular for G2 arrays). 

The data we have accumulated on the maximal cross-correlation between pairs of Wi or G2 arrays generated 
in fields of Germain prime size can be seen in Table |3] Inspection of this table reveals that the Wi column 
behaves approximately "logarithmically" with respect to the p column, and this is reminiscent of the situation 
in Table [T] It turns out that the same formula we suggested for Table [T] namely 1 + [ln(p)], where [■] again 
denotes rounding, is an excellent fit here as well! More precisely, 13 out of the 19 entries in Table [3] (about 70%) 
obey the formula without error, while all entries obey the formula with an error margin of ±1. Surprisingly 
then, it appears that the 2 seemingly unrelated experiments are somehow related after all, in the sense that the 
first order approximation of the results is the same. 

Note that finding the maximal cross-correlation for pairs of G2 arrays is a much heavier computational task 
than for pairs of Wi arrays: 

Theorem 6. Let Cg{p) and Cw{p) denote the complexities involved in determining max max (u,w) for 

{u,v) {/i7^/2) 

G2 and Wi permutations in F(p), p prime, respectively. Then, 

Cajp) „£(P-1) 

-— , asp -^00 

Cw{p) P 

Proof. We will present a sketch of the proof and work with asymptotic estimations. In F{p) we can gen- 
erate (p — l)4>{p — 1) Wi arrays and 4>'^{p — 1) G2 arrays. In the case of G2 arrays we need to compute 

^IlSE. )i'f' ) ) cross-correlation arrays with (2(p — 2) — 1)^ ^ 4p^ entries in each. In the case of Wi 

arrays, however, we only need to compute the vector of the cross-correlation array corresponding to u = 0, 

which contains 2(p — 1) — 1 2p entries (we obviously need to compute — Mil! ^^^^ )'t'iP ) ) 

such vectors). 

The reason is not difficult to see: assume that we have to compute 'i' fi,f2{'U;V) with m > without loss of 
generality; clearly ^/^j, (it,i;) < f^^j^i^jv), where /" denotes the permutation /i but with its entries shifted 
u times to the left! 

Overall, then: 

Ccip) i0^(p-l)4p2 o<^'(p-l) 



= 2- 



Cwip) ip2<^2(p_ l)2p 

□ 

This result explains why we are unable to offer as many results for G2 arrays as for Wi arrays in Table [3] 
Note that, according to Theorem |4l whenever p is a Germain prime and /i, /2 are Wi permutations generated 
in F(p), the maximal value *E'/i,/2 (ft, 0) can attain is 2. Since Table |3] yields higher values for the maximal 
cross-correlation, necessarily this maximum is attained for some v ^ 0. 
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p 


Wi 


G2 


5 


2 


2 


7 


2 


2 


11 


3 


4 


23 


4 


6 


47 


5 


8 


59 


5 


12 


83 


5 


9 


107 


5 


10 


167 


6 


12 


179 


6 


12 


227 


6 


13 



Tabic 3: The maximal cross-correlation between pairs of 
prime size. 



p 


Wi 


263 


7 


347 


6 


359 


6 


383 


7 


467 


7 


479 


7 


503 


7 


563 


8 



1 or G2 arrays built in the first few fields of Germain 



6 Summary and future work 

In this work we have presented the results of some of our numerical experiments on Costas arrays that we have 
hitherto been unable to account for, or even formulate relevant conjectures on; in that sense, the entire paper 
is a plan for future work. We chose the 3 most complex and intriguing experiments we have encountered so far, 
and presented all of the evidence we have gathered. It is our firm belief that these results are instances of as 
yet unexplored number theoretic or algebraic properties of (some families of) finite fields, so that further study 
of these matters will greatly benefit both pure mathematics and applications. We can only hope that we will 
successfully arouse the interest of a reader, perhaps better versed in the relevant techniques than ourselves, who 
will unravel the mysteries of these experiments. In such a contingency we ask that we be informed. 
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